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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed January 31 , 2007 have been fully considered but they 

are not persuasive. 

First, applicant argues that the combination of Rosser and Kitsukawa does 
not disclose the amended limitation of "wherein said one or more interactive 
virtual objects are dynamic" (applicant's remarks, pages 16-17). 

In response, the cited portion of Rosser, specifically col. 7, lines 38-45, 
states "In particular, the down stream unit 46 is able to use the information 
generated by the recognition unit 18, the tracking unit 20, and the occlusion mask 
production unit 22 to perform seamless insertion of still, animated, and live video 
indicia into the video stream in a way that can make the inserted indicia appear 
to the end user as if it were part of the original scene 10." [emphasis added]. The 
dynamic nature of the virtual objects is taught by Rosser because the "inserted 
indicia" correspond to the claimed "virtual objects" and are dynamic because they 
are described as being animated. 

Second, applicant argues against the examiner's use of official notice on 
claims 24, 44, and 62 (applicant's remarks, page 17). 

Regarding claim 24, the examiner took official notice that "it is notoriously 
well known to delete objects from memory when they are no longer needed, as 
this frees up said memory for storage of new objects in the future." This 
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assertion is supported by the prior art, as evidenced by US Patent No. 6,463,468 
to Buch et al., who teaches an advertisement delivery system, wherein 
advertisements are downloaded to a local receiver, displayed to a user, the 
viewing of the advertisement is reported upstream, and the advertisement is 
subsequently deleted to make room for new advertisements. See col. 9, lines 
35-53. 

Regarding claim 44, the examiner took official notice that "it is notoriously 
well known to download additional data for interactive applications on request 
from a broadcast center or head end, conserving both transmission bandwidth, 
as the data is only sent when requested by a viewer, and local storage, as the 
user's terminal does not have to store what could potentially be an overwhelming 
amount of additional content that the user would likely only access a fraction of." 
This assertion is supported by the prior art, as evidenced by US Patent No. 
5,636,346 to Saxe, who teaches an interactive television system where additional 
information or content is only downloaded to clients upon being requested by 
said client. See col. 8, lines 48-65 and col. 9, lines 36-56. 

Regarding claim 62, the examiner took official notice that "it is notoriously 
well known in the art to send interactive triggers which automatically initiate an 
interactive feature in program broadcasts, a tool used by broadcasters to create 
media enhanced programming according to a predetermined schedule, such as 
the use of ATVEF triggers." This assertion is supported by the prior art, as 
evidenced by US Pre-grant Publication No. 2002/0056129, who teaches an 
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interactive television system wherein triggers are sent which automatically initiate 
interactive features in program broadcasts without requiring user input. See 
Abstract and paragraphs 31 and 36-40. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claim 1-13, 15-33, 43-50, 52-54, 56, 57, and 59-64 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Rosser (6,446,261 , of record) in view of Kitsukawa et 
al. (6,282,713, of record) [Kitsukawa]. 

Regarding claim 1 , Rosser discloses a method for targeting virtual 
advertisements comprising: 

assigning insertion spots to a program (col. 6, lines 12-39); 

assigning virtual objects to the virtual advertisement spot (advertisements 
and other insertion data are coordinated with images and scenes in view of a 
displayed video, col. 13, lines 13-48), wherein said virtual objects are dynamic 
(col. 7, lines 38-45); 

generating a retrieval plan (the data necessary to enable a local terminal 
to select and seamlessly insert advertisement data, col. 6, lines 1 1-48 and col. 
14, lines 26-47); and 
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providing the retrieval plan to a terminal, wherein the retrieval plan 
instructs the terminals to select virtual objects (col. 6, line 49 - col. 7 line 45 and 
col. 14, lines 26-47). 

Rosser fails to disclose the advertisements are interactive. 

In an analogous art, Kitsukawa discloses providing interactive 
advertisements to viewers by indicating with superimposed markings interactive 
regions on a screen by which users may request additional information or even 
order an advertised product (col. 2 line 18 - col. 3 line 19 and col. 6 line 40 - col. 
7 line 40), providing the benefit of more engaging and effective advertising (col. 1 
line 56 -col. 2 line 15). 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the method disclosed by Rosser to include interactivity, as disclosed 
by Kitsukawa, for the benefit of providing more engaging and effective 
advertising that is of more use to both viewers and advertisers. 

Regarding claim 2, Rosser and Kitsukawa disclose the method of claim 1 , 
wherein generating the retrieval plan comprises assigning the terminal to one or 
more groups, designating a unique group mask for one or more of the groups, 
and assigning one or more of the groups to one of the interactive virtual objects, 
wherein the group mask indicates whether the terminal displays a particular 
interactive object (Rosser teaches advertisers direct advertisements to specific 
groups according to viewer usage profiles, col. 4, lines 15-41 , where the 'group 



Application/Control Number: 09/975,312 Page 6 

Art Unit: 2623 

mask' is information provided which the local receiver uses to correlate received 
advertisement data with the local user profile to select advertisements for display, 
col. 7, lines 46-58 and col. 13 line 13 -col. 14 line 25). 

Regarding claim 3, Rosser and Kitsukawa disclose the method of claim 2, 
wherein the step of assigning the terminal to one or more groups comprises 
generating group assignment rules (a step performed by the advertisers), 
delivering group assignment rules to the terminal (Rosser, col. 13, lines 34-37), 
storing the group assignment rules at the terminal (an inherent step required by 
the set top in order to process said rules for the subsequent determining step), 
and determining one or more group assignments based on the group assignment 
rules and data related to the terminal (Rosser, col. 13 line 49 - col. 14 line 25). 

Regarding claim 4, Rosser and Kitsukawa disclose the method of claim 3, 
wherein the data related to the terminal includes programs watched data 
(Rosser, figs. 3 and 5, col. 7 line 59 - col. 8 line 19). 

Regarding claim 5, Rosser and Kitsukawa disclose the method of claim 1, 
wherein the retrieval plan and group assignment rules are periodically sent to the 
terminal (Rosser teaches the data used by the terminal for selecting 
advertisements is sent over the VBI, col. 6, lines 49-67). 
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Regarding claim 6, Rosser discloses a method of targeting virtual objects 
comprising: 

providing a program containing one or more virtual object locations (col. 6 
line 12 -col. 7 line 45); 

providing virtual objects for one or more of the virtual object locations (col. 
7, lines 1-20), wherein said virtual objects are dynamic (col. 7, lines 38-45); 

providing at least one alternative virtual object for at least one of the one 
or more virtual object locations (col. 7, lines 46-58, wherein the different 
insertions for different viewers may be for the same object location, col. 4, lines 
31-41); and 

generating a retrieval plan at a user's terminal, wherein the retrieval plan 
designates which of the one or more object locations displays an alternate virtual 
object (col. 7, lines 46-58; col. 13, lines 13-48; and col. 14, lines 26-47). 

Rosser fails to disclose the objects are interactive. 

In an analogous art, Kitsukawa discloses providing interactive 
advertisements to viewers by indicating with superimposed markings interactive 
regions on a screen by which users may request additional information or even 
order an advertised product (col. 2 line 18 - col. 3 line 19 and col. 6 line 40 - col. 
7 line 40), providing the benefit of more engaging and effective advertising (col. 1 
line 56 -col. 2 line 15). 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the method disclosed by Rosser to include interactivity, as disclosed 
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by Kitsukawa, for the benefit of providing more engaging and effective 
advertising that is of more use to both viewers and advertisers. 

Regarding claims 7 and 8, Rosser and Kitsukawa disclose the method of 
claim 6, wherein the program is a television program or advertisement 
(Kitsukawa, col. 6, lines 40-48). 

Regarding claim 9 and 10, Rosser and Kitsukawa disclose the method of 
claim 6, wherein at least one of the interactive virtual object locations is fixed in 
position across frames of the program or moves spatially in the program with 
time (Rosser, col. 7, lines 38-45 and col. 13, lines 25-32). 

Regarding claim 1 1 , Rosser and Kitsukawa disclose the method of claim 
6, wherein at least one object is non-interactive (the objects disclosed by Rosser 
are ordinarily non-interactive). 

Regarding claim 12, Rosser and Kitsukawa disclose the method of claim 
6, wherein the program is broadcast to the terminal (Rosser, col. 7, lines 1-20), 
further comprising: 

creating categories of interactive virtual objects and content (Rosser 
teaches categorizing content according to type, col. 8 line 56 - col. 9 line 30 and 
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col. 1 1 line 62 - col. 12 line 34 and the virtual objects to be inserted into the 
content according to desired demographic, col. 13 line 49 - col. 14 line 25); 

defining group categories (Rosser, fig. 5, "movies", "sit. com", "cartoons", 

etc.); 

for one or more defined group categories, defining at least one group 
(Rosser teaches advertisers use the group categories of viewer profiles to define 
market segments, col. 12 line 55 - col. 13 line 12); 

assigning a television terminals, for the one or more groups, to the at least 
one group (Rosser, col. 13, lines 49-63); 

creating a group assignment matrix based on the categories of the 
interactive virtual objects, the group categories, and the group assignment 
(Rosser teaches demographic information, programming types, and viewing 
intensity of programming types are used to create a comprehensive viewer 
profiles, col. 9 line 49 - col. 10 line 5 and col. 12 line 55 - col. 13 line 12); 

storing the group assignment matrix in the terminal (Rosser, fig. 1 , viewer 
profile 50); and 

comparing the retrieval plan to the group assignment matrix to determine 
interactive virtual objects to display in the one or more interactive virtual object 
locations (Rosser, col. 13, lines 13-48). 

Regarding claim 13, Rosser and Kitsukawa disclose the method of claim 
12, wherein generating the retrieval plan comprises: 
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assigning the interactive virtual objects to the interactive virtual object 
locations (Rosser teaches locating the regions into which advertising is to be 
inserted and associating plural advertisements with these locations, col. 6, lines 
1 2-39 and col. 1 3, lines 1 3-48); 

assigning the alternate interactive virtual objects to interactive virtual 
object locations (Rosser teaches locating the regions into which advertising is to 
be inserted and associating plural advertisements with these locations, col. 6, 
lines 12-39 and col. 13, lines 13-48); 

assigning a group to the interactive virtual objects and the alternate 
interactive virtual objects (Rosser, col. 13, lines 34-48); 

creating a group mask assignment, wherein the group mask assignment is 
used by the terminal to compare the retrieval plan to the group assignment matrix 
(Rosser, col. 13 line 49 - col. 14 line 25). 

Regarding claim 15, Rosser and Kitsukawa disclose the method of claim 
13, wherein groups are defined based on characteristics of users (Rosser, col. 
13, lines 34-48). 

Regarding claims 16-20, Rosser and Kitsukawa disclose the method of 
claim 15 wherein the characteristics include user demographic information 
(Rosser, col. 12 line 55 - col. 13 line 12), user entered information (Rosser, col. 
4, lines 42-48 and col. 12 line 55 - col. 13 line 12, where user provided 
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information used to interpret viewing intensities includes age, gender, income, 
etc.). programs watched data (Rosser, col. 8, lines 20-38), interactive virtual 
objects watched data (Rosser, col. 8, lines 20-38), and user activation of the 
interactive virtual objects (as user activation initiates the viewing a new material, 
Kitsukawa, col. 7, lines 21-40, where Rosser teaches tracking the viewing of all 
viewed material to track viewing intensity, col. 7 line 59 - col. 8 line 38). 

Regarding claim 21, Rosser and Kitsukawa disclose the method of claim 
12, wherein the terminal is a television set top terminal (Rosser, fig. 1 , set top 
device 44). 

Regarding claim 22, Rosser and Kitsukawa disclose the method of claim 
12, wherein the terminal is incorporated into a personal computer (Rosser, col. 
15, lines 10-28). 

Regarding claim 23, Rosser and Kitsukawa disclose the method of claim 
12, wherein the television terminal is coupled to a satellite television receiver 
(Rosser, fig. 4, satellite receiver 136). 

Regarding claim 24, Rosser and Kitsukawa disclose the method of claim 
12, and further disclose at the terminal, recording in a memory an identification of 
a virtual object displayed in a virtual object location and providing the 
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identification to a remote site (Kitsukawa, col. 12, lines 1-20), and but fail to 
disclose deleting the identification from memory. 

It is notoriously well known to delete objects from memory when they are 
no longer needed, as this frees up said memory for storage of new objects in the 
future. 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the method disclosed by Rosser and Kitsukawa to include deleting 
identifications from memory, for the benefit of freeing memory for the storage of 
new identifications in the future. 

Regarding claim 25, Rosser and Kitsukawa disclose the method of claim 
12, wherein the retrieval plan is provided with the transmission of the program 
and periodically to the terminal, the terminal storing the retrieval plan in memory 
(Rosser teaches the 'extra data' is sent in the vertical blanking interval, col. 6, 
lines 49-67). 

Regarding claim 26, Rosser discloses a method of targeting virtual objects 
to terminals, comprising: 

creating a package of targeted virtual objects (col. 6, lines 8-48), wherein 
said virtual objects are dynamic (col. 7, lines 38-45); 

providing the package to the terminals (col. 6, lines 49-67); 
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generating a group assignment matrix, wherein the group assignment 
matrix assigns terminals to groups (col. 13 line 49 - col. 14 line 25); 

generating a retrieval plan (col. 6, lines 12-39 and col. 14, lines 26-47); 

storing the retrieval plan at the terminals (col. 14, lines 26-47); and 

providing a program to the terminals, the program including virtual object 
locations, therein the retrieval plan designates virtual objects to the displayed 
during a display of the program (col. 13, lines 13-48). 

Rosser fails to disclose the objects are interactive. 

In an analogous art, Kitsukawa discloses providing interactive 
advertisements to viewers by indicating with superimposed markings interactive 
regions on a screen by which users may request additional information or even 
order an advertised product (col. 2 line 18 - col. 3 line 19 and col. 6 line 40 - col. 
7 line 40), providing the benefit of more engaging and effective advertising (col. 1 
line 56 -col. 2 line 15). 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the method disclosed by Rosser to include interactivity, as disclosed 
by Kitsukawa, for the benefit of providing more engaging and effective 
advertising that is of more use to both viewers and advertisers. 

Regarding claim 27, Rosser and Kitsukawa disclose the method of claim 
26, and further disclose at a terminal, receiving the program and retrieving one of 
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the targeted virtual object for display in a virtual object location (Rosser, col. 13, 
lines 13-48). 

Regarding claim 28, Rosser and Kitsukawa disclose the method of claim 
27, and further disclose the retrieval step comprises comparing the group 
assignment matrix to the retrieval plan and selecting an interactive virtual object 
for display based on the comparison (Rosser, col. 13, lines 13-48, as selection of 
an advertisement requires comparison of the advertisement's targeted audience 
data with the locally stored profile and the information which designates how and 
where to insert each advertisement in order to finally determine which 
advertisement is to be selected when the opportunity to insert that advertisement 
arises, col. 13 line 28 "...when a particular image or scene is in view", therefore if 
the group assignment matrix designates that particular ad should be shown to a 
particular viewer, the system still must perform a determination to see if the 
advertisement can be inserted). 

Regarding claim 29, Rosser and Kitsukawa disclose the method of claim 
26, wherein the virtual object locations contain interactive virtual objects (Rosser, 
col. 10, lines 21-35 and Kitsukawa, fig. 5), and further comprising receiving a 
selection of the interactive virtual object and linking a terminal selecting the 
interactive virtual object to an alternate program (Kitsukawa, col. 7, lines 21-40). 
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Regarding claim 30, Rosser and Kitsukawa disclose the method of claim 
29, wherein the alternative program comprises an Internet web site (Kitsukawa, 
col. 8, lines 37-57). 

Regarding claim 31 , Rosser and Kitsukawa disclose the method of claim 
26, wherein the step of generating the group assignment matrix comprises 
generating group assignment rules, delivering group assignment rules to the 
terminals, and determine one or more group assignments at the terminals based 
on the group assignment rules and individual terminal data and terminal group 
data (Rosser, col. 13 line 13 - col. 14 line 25). 

Regarding claim 32, Rosser and Kitsukawa disclose the method of claim 
31, wherein the individual terminal data comprises programs watched data 
(Rosser, col. 7 line 59 - col. 8 line 19). 

Regarding claim 33, Rosser and Kitsukawa disclose the method of claim 
31 , wherein the group assignment rules are stored in the terminals (Rosser, col. 
13, lines 19-25). 

Regarding claim 43, Rosser discloses a system for targeting virtual 
objects, comprising: 
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a virtual object insertion center (fig. 1, LVIS 16) that defines virtual object 
locations in program content for insertion of virtual objects, the insertion center 
comprising a virtual object location definer, a virtual object selector coupled to the 
definer, and a virtual object manager coupled to the definer and the selector (col. 
6, lines 12-48), and 

a terminal, coupled to the insertion center, the receives virtual objects, 
wherein said virtual objects are dynamic (col. 7, lines 38-45), and the program 
content having virtual object locations (fig. 1 , set top device 44), wherein the 
terminal comprises a location processor that detects virtual object locations in the 
program content and a selector processor that determines which of the received 
virtual objects are to be placed in allowable content locations for the virtual 
objects (col. 7, lines 21-45 and col. 13, lines 13-48). 

Rosser fails to disclose the objects are interactive and an interactive 
virtual object trigger processor that receives and processes an interactive 
selection. 

In an analogous art, Kitsukawa discloses providing interactive 
advertisements to viewers by indicating with superimposed markings interactive 
regions on a screen by which users may request additional information or even 
order an advertised product (col. 2 line 18 - col. 3 line 19 and col. 6 line 40 - col. 
7 line 40), providing the benefit of more engaging and effective advertising (col. 1 
line 56 -col. 2 line 15). 
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It would have been obvious at the time to a person of ordinary skill in the 
art to modify the method disclosed by Rosser to include interactivity, as disclosed 
by Kitsukawa, for the benefit of providing more engaging and effective 
advertising that is of more use to both viewers and advertisers. 

Regarding claim 44, Rosser and Kitsukawa disclose the system of claim 
43, but fail to disclose the processed interactive selection is received at the 
insertion center, and wherein the received selection triggers a response that is 
sent to the terminal. 

It is notoriously well known to download additional data for interactive 
applications on request from a broadcast center or head end, conserving both 
transmission bandwidth, as the data is only sent when requested by a viewer, 
and local storage, as the user's terminal does not have to store what could 
potentially be an overwhelming amount of additional content that the user would 
likely only access a fraction of. 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the system disclosed by Rosser and Kitsukawa to include the 
processed interactive selection is received at the insertion center, and wherein 
the received selection triggers a response that is sent to the terminal, for the 
benefit of conserving both transmission bandwidth and local storage. 
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Regarding claim 45, Rosser and Kitsukawa disclose the system of claim 
43, wherein the processed interactive selections are retained at the terminal, 
wherein the received selection triggers a response that is generated at the 
terminal (Kitsukawa, col. 7, lines 21-40). 

Regarding claim 46, Rosser and Kitsukawa disclose the system of claim 
43, wherein the interactive virtual objects are delivered to the terminal by a cable 
television system, wireless broadcast system, a satellite broadcasts system, a 
wired data network, or a terrestrial television broadcast network (Rosser, col. 7, 
lines 1-20). 

Regarding claims 47 and 48, Rosser and Kitsukawa disclose the system 
of claim 43, and further disclose an interactive virtual object retrieval plan, 
wherein the interactive virtual objects and the retrieval plan are delivered from an 
interactive virtual object delivery system [the insertion center] (Rosser, col. 6, 
lines 12-67). 

Regarding claim 49, Rosser and Kitsukawa disclose the system of claim 
48, and further disclose replacement virtual objects and a replacement retrieval 
plan are delivered from the local insertion center (Rosser, col. 4, lines 31-41 and 
col. 10, lines 21-51). 
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Regarding claim 50, Rosser and Kitsukawa disclose the system of claim 
43, wherein an interactive virtual object comprises: 

an interactive virtual object identifier (an inherent feature, as the digital 
objects are individually selectable and distinct, Rosser, col. 13, lines 13-48); 

interactive virtual object placement rules, wherein the rules provide 
guidance to the terminal in managing insertion of interactive virtual objects into 
the program content (col. 14 line 48 - col. 15 line 5); 

an interactive virtual object digital module, wherein the module comprises 
a digital file of the interactive virtual object (the graphics or videos for insertion, 
Rosser, col. 7, lines 1-20); and 

an interactive virtual object trigger action that defines an action to be taken 
upon triggering of the virtual object at the terminal (Kitsukawa, col. 7, lines 21- 
40). 

Regarding claim 52, Rosser and Kitsukawa disclose the system of claim 
50, wherein the interactive virtual object trigger action initiates an interactive 
request to a location external to the terminal (Kitsukawa, col. 8, lines 37-57). 

Regarding claim 53, Rosser and Kitsukawa disclose the system of claim 
52, wherein the location external to the system further comprises an interactive 
virtual object management center and an interactive virtual object servicing 
center coupled to the interactive virtual object management center, wherein the 
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management center provides interactive virtual object response management 
guidelines to the servicing center, and wherein the guidelines determine an 
appropriate response based on receipt of an interactive request from the terminal 
(Kitsukawa, col. 1 1 line 62 - col. 12 line 20, wherein redeeming a coupon via an 
electronic link is to sends and Interactive request' to a remote computer which 
has been programmed or instructed by a merchandise dealer or retailer with 
instructions for coupon redemption). 

Regarding claim 54, Rosser and Kitsukawa disclose the system of claim 
43, wherein the terminal comprises: 

an interactive virtual object extractor that extracts interactive virtual objects 
from data received at the terminal (Rosser, col. 7, lines 46-58); 

an interactive virtual object location detector processor, coupled to the 
extractor, that determines the allowable content locations for the interactive 
virtual objects (Rosser, col. 7, lines 21-45 and col. 10, lines 21-51); 

an interactive virtual object insertion processor, coupled to the selector 
processor, that inserts the selected interactive virtual objects into the allowable 
content locations (Rosser, col. 7, lines 21-45 and col. 10, lines 21-51). 

Regarding claims 56 and 57, Rosser and Kitsukawa disclose the system 
of claim 43, wherein the interactive virtual objects are selectable by a user at the 
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terminal and wherein the interactive selection is processed automatically by the 
terminal (Kitsukawa, col. 7, lines 21-40). 

Regarding claim 59, Rosser discloses a method of targeting virtual objects 
to terminals comprising: 

creating a package of targeted virtual objects (col. 6, lines 8-48), wherein 
said virtual objects are dynamic (col. 7, lines 38-45); 

providing the package to terminals (col. 6, lines 49-67); 

generating a group assignment matrix, wherein the group assignment 
matrix assigns terminals to groups (col. 13 line 49 - col. 14 line 25); 

generating a retrieval plan (col. 6, lines 12-39 and col. 14, lines 26-47); 

and 

providing a program to the terminals, the program including virtual object 
locations, wherein the retrieval plan designates virtual objects to the displayed 
during a display of the program (col. 13, lines 13-48). 

Rosser fails to disclose the objects are interactive. 

In an analogous art, Kitsukawa discloses providing interactive 
advertisements to viewers by indicating with superimposed markings interactive 
regions on a screen by which users may request additional information or even 
order an advertised product (col. 2 line 18 - col. 3 line 19 and col. 6 line 40 - col. 
7 line 40), providing the benefit of more engaging and effective advertising (col. 1 
line 56 -col. 2 line 15). 



Application/Control Number: 09/975,31 2 Page 22 

Art Unit: 2623 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the method disclosed by Rosser to include interactivity, as disclosed 
by Kitsukawa, for the benefit of providing more engaging and effective 
advertising that is of more use to both viewers and advertisers. 

Regarding claim 60, Rosser and Kitsukawa disclose the method of claim 

59, wherein one or more virtual objects include triggers that initiate a signal from 
the terminal (Kitsukawa, col. 7, lines 21-40), the method further comprising 
receiving a trigger, retrieving an interactive virtual object trigger action in 
response to receipt of the trigger and determining if the interactive virtual object 
trigger action requires initiation of an interactive request (Kitsukawa, col. 7, lines 
21-40 and col. 8, lines 37-58). 

Regarding claim 61 , Rosser and Kitsukawa disclose the method of claim 

60, wherein the interactive virtual object trigger action requires initiation of the 
interactive request (user actuation, such as Clicking 1 on a portion of the screen), 
the method further comprising sending the interactive request, awaiting an 
interactive response, and initiating an interactive action based on the interactive 
response (Kitsukawa, col. 7, lines 21-40 and col. 8, lines 37-58). 

Regarding claim 62, Rosser and Kitsukawa disclose the method of claim 
60, but fail to disclose the interactive virtual object trigger action does not require 
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initiation of the interactive request, the method further comprising initiating 
processing required by the interactive virtual object trigger action. 

It is notoriously well known in the art to send interactive triggers which 
automatically initiate an interactive feature in program broadcasts, a tool used by 
broadcasters to create media enhanced programming according to a 
predetermined schedule, such as the use of ATVEF triggers. 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the method disclosed by Rosser and Kitsukawa to include the 
interactive virtual object trigger action does not require initiation of the interactive 
request, the method further comprising initiating processing required by the 
interactive virtual object trigger action, for the benefit of allowing broadcasters to 
present interactive content in accordance with a predetermined schedule. 

Regarding claim 63, Rosser and Kitsukawa disclose the method of claim 
59, wherein the virtual object locations contain interactive virtual objects (Rosser, 
col. 10, lines 21-35 and Kitsukawa, fig. 5), and further comprising receiving a 
selection of the interactive virtual object and linking a terminal selecting the 
interactive virtual object to an alternate program (Kitsukawa, col. 7, lines 21-40). 

Regarding claim 64, Rosser and Kitsukawa disclose the method of claim 
63, wherein the alternative program comprises an Internet web site (Kitsukawa, 
col. 8, lines 37-57). 
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4. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over Rosser 
and Kitsukawa as applied to claim 13 above, and further in view of Hendricks et al. 
(5,600,364, of record) [Hendricks] and Del Sesto et al. (6,530,082, of record) [Del Sesto] 
Regarding claim 14, Rosser and Kitsukawa disclose the method of claim 
1 3, but fail to disclose wherein assigning the group to each of the default 
interactive virtual objects and the alternate interactive virtual objects comprises 
ranking programs based on categories of targeted interactive virtual objects and 
a percentage of total viewers who view one or more of the programs, ranking of 
targeted interactive virtual objects based on a second percentage of total 
viewers, determining, for the one or more ranked programs and the targeting 
categories, targeted interactive virtual objects with overall highest rankings, 
based on the first and the second percentages, assigning targeted interactive 
virtual objects with the overall highest ranking to be displayed as the interactive 
virtual objects, and assigning targeted virtual objects with lower overall ranking to 
be displayed as the alternate interactive virtual objects. 

In an analogous art, Hendricks teaches an advertisement selection routine 
which selects advertisements for transmission to viewers that comprises ranking 
programs based on categories of targeted advertisements (col. 38, lines 54-61), 
ranking of targeted advertisements (col. 39, lines 7-39), determining, for the one 
or more ranked programs and the targeting categories, targeted advertisements 
with overall highest rankings, assigning targeted advertisements with the overall 
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highest ranking to be displayed as the advertisements, and assigning targeted 
advertisements with lower overall ranking to be displayed as the alternate 
advertisements (col. 39, lines 40-53), for the benefit of performing a correlation 
between advertisements and viewed programming which associates 
advertisements with programming that improves the targeting process, which 
benefits the advertisement providers. 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the method of Rosser and Kitsukawa to include ranking programs 
based on categories of targeted advertisements, ranking of targeted 
advertisements, determining, for the one or more ranked programs and the 
targeting categories, targeted advertisements with overall highest rankings, 
assigning targeted advertisements with the overall highest ranking to be 
displayed as the advertisements, and assigning targeted advertisements with 
lower overall ranking to be displayed as the alternate advertisements, for the 
benefit of performing a correlation between advertisements and viewed 
programming which associates advertisements with programming that improves 
the targeting process, which benefits the advertisement providers, as Rosser 
leaves it entirely up to advertisers to select on their own which viewers they want 
to target their ads to based only upon a statistical sample (Rosser, col. 12 line 55 
-col. 13 line 12). 

Rosser, Kitsukawa, and Hendricks fail to disclose tracking the 
percentages of total viewers for the programs and virtual objects. 
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In an analogous art, Del Sesto discloses tracking the percentages of 
viewership of both broadcast programs and commercials (col. 15 line 55 - col. 16 
line 29 and col. 16, lines 47-67) providing more detailed reports of viewership 
data to broadcasters and advertisers (col. 2 line 43 - col. 3 line 7). 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the method of Rosser, Kitsukawa, and Hendricks to include tracking 
the percentages of total viewers for the programs and virtual objects, as taught 
by Del Sesto, for the benefit of providing more detailed reports of viewership data 
to broadcasters and advertisers. The ranking step would then be based on these 
percentages because Rosser teaches it is desirable to sell segments of an 
audience to different advertisers based on profile factors (Rosser, col. 13, lines 4- 
12 and lines 57-63), and Del Sesto teaches determining these segments 
according to total viewer percentages (Del Sesto, col. 2 line 53 - col. 3 line 7). 

5. Claims 34-42 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Rosser in view of Kitsukawa and Zigmond et al. (6,698,020, of record) [Zigmond]. 

Regarding claim 34, Rosser discloses a terminal for targeting virtual 
objects comprising: 

a connector that receives the virtual objects and virtual object locations 
and metadata (col. 7, lines 21-45), wherein said virtual objects are dynamic (col. 
7, lines 38-45); 
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a virtual objects extractor coupled to the connector that extracts the virtual 
objects, the locations, and the metadata (col. 7, lines 46-58); and 

a virtual object selector processor that determines an virtual object 
placement for stored virtual objects (col. 13, lines 13-48). 

Rosser fails to disclose the objects are interactive and a storage processor 
coupled to the extractor that determines which of the extracted virtual objects are 
targeted to the terminal and saves the targeted virtual objects in a memory. 

In an analogous art, Kitsukawa discloses providing interactive 
advertisements to viewers by indicating with superimposed markings interactive 
regions on a screen by which users may request additional information or even 
order an advertised product (col. 2 line 18 - col. 3 line 19 and col. 6 line 40 - col. 
7 line 40), providing the benefit of more engaging and effective advertising (col. 1 
line 56 -col. 2 line 15). 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the terminal disclosed by Rosser to include interactivity, as 
disclosed by Kitsukawa, for the benefit of providing more engaging and effective 
advertising that is of more use to both viewers and advertisers. 

Rosser and Kitsukawa fail to disclose a storage processor coupled to the 
extractor that determines which of the extracted virtual objects are targeted to the 
terminal and saves the targeted virtual objects in a memory. 

In an analogous art, Zigmond discloses and advertisement insertion 
system wherein advertisements are pre-screened and only those advertisements 
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which are targeted to the terminal are stored, more efficiently utilizing the limited 
amount of storage space available in the terminal (col. 15, lines 17-34). 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the terminal disclosed by Rosser and Kitsukawa to include a 
storage processor that determines which of the extracted virtual objects are 
targeted to the terminal and saves the targeted virtual objects in a memory, as 
taught by Zigmond, for the benefit of more efficiently utilizing the limited amount 
of storage available in the terminal. 

Regarding claim 35, Rosser, Kitsukawa, and Zigmond disclose the 
terminal of claim 34, wherein the interactive virtual objects are received with 
programming content and wherein the extractor extracts the interactive virtual 
objects from the programming content (Rosser, col. 7, lines 46-57). 

Regarding claims 36 and 37, Rosser, Kitsukawa, and Zigmond disclose 
the terminal of claim 34, wherein the interactive virtual objects are received over 
the Internet (Zigmond, col. 14 line 66 - col. 15 line 16). 

Regarding claims 38-41 , Rosser, Kitsukawa, and Zigmond disclose the 
terminal of claims 34 and 38, wherein the terminal is a set top terminal (Rosser, 
fig. 1 , set top device 44), a television (Zigmond, col. 7, lines 50-67), or a personal 
computer (Rosser, col. 15, lines 10-28). 
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Regarding claim 42, Rosser, Kitsukawa, and Zigmond disclose the 
terminal of claim 34, and further disclose a placement log coupled to the selector 
processor that logs the placement of an interactive virtual object and further logs 
and interactive response to the interactive virtual object, wherein the placement 
and the response are stored in the memory, and wherein the selector processor 
uses the placement and the response in determining further interactive virtual 
objects (Zigmond, col. 9, lines 39-55). 

6. Claim 51 rejected under 35 U.S.C. 103(a) as being unpatentable over Rosser 
and Kitsukawa as applied to claim 50 above, and further in view of Del Sesto. 

Regarding claim 51 , Rosser and Kitsukawa disclose the system of claim 
50, but fail to disclose the interactive virtual object further comprises a virtual 
object applet that provides software capable of initiation by a source external to 
the terminal. 

In an analogous art, Del Sesto teaches a viewership monitoring system 
wherein interactive application data (col. 6, lines 33-54) is downloaded to a user's 
terminal (col. 7 line 36 - col. 8 line 38) that is selectively initiated by a remote 
source (col. 9 line 66 - col. 10 line 35), which provides the benefit of selective 
control over the reporting of user interactions with interactive objects (col. 3 line 
49 -col. 4 line 16 and col. 12 line 52 -col. 13 line 12). 
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It would have been obvious at the time to a person of ordinary skill in the 
art to modify the system of Rosser and Kitsukawa to include a virtual object 
applet that provides software capable of initiation by a source external to the 
terminal, as taught by Del Sesto, for the benefit of selective control over the 
reporting of user interactions with interactive objects, as broadcasters rely on 
statistical samples as opposed to a fully comprehensive report on viewership 
data (Del Sesto, col. 3, lines 49-67 and Rosser, col. 12, lines 55-63). 

7. Claim 55 and 58 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Rosser and Kitsukawa as applied to claims 43 and 54 above, and further in view of 
Zigmond. 

Regarding claim 55, Rosser and Kitsukawa disclose the system of claim 
54, but fail to disclose a storage management processor coupled to the extractor, 
wherein the management processor uses an interactive virtual object retrieval 
plan to determine which received interactive virtual objects are to be stored at the 
terminal. 

In an analogous art, Zigmond discloses and advertisement insertion 
system wherein advertisements are pre-screened and only those advertisements 
which are targeted to the terminal are stored, more efficiently utilizing the limited 
amount of storage space available in the terminal (col. 15, lines 17-34). 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the terminal disclosed by Rosser and Kitsukawa to include a 
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storage management processor coupled to the extractor, wherein the 
management processor uses an interactive virtual object retrieval plan to 
determine which received interactive virtual objects are to be stored at the 
terminal, as taught by Zigmond, for the benefit of more efficiently utilizing the 
limited amount of storage available in the terminal. 

Regarding claim 58, Rosser and Kitsukawa disclose the system of claim 
43, but fail to disclose the terminal further comprises a virtual object placement 
log, wherein when a virtual object is placed in a virtual object location, the 
selector processor records the event in the virtual object placement log. 

In an analogous art, Zigmond teaches an advertisement insertion system 
wherein the system tracks the placement and viewing of advertisements by a 
viewer (fig. 4, statistics aggregation 61 , col. 9, lines 21-55), for the benefit of 
collecting viewership statistics relating to the advertisement (col. 9, lines 33-38). 

It would have been obvious at the time to a person of ordinary skill in the 
art to modify the system disclosed by Rosser and Kitsukawa to include a virtual 
object placement log, wherein when a virtual object is placed in a virtual object 
location, the selector processor records the event in the virtual object placement 
log, as taught by Zigmond, for the benefit of collecting viewership statistics 
relating to the advertisement. Such statistics, in addition to assisting advertisers 
in determining the effectiveness of their ads, are also more generally used to 
determine how much a broadcaster can charge an advertiser for ad exposure. 
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Conclusion 

8. Applicant's amendment necessitated the new grounds of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 



9. The following are suggested formats for either a Certificate of Mailing or 
Certificate of Transmission under 37 CFR 1.8(a). The certification may be included with 
all correspondence concerning this application or proceeding to establish a date of 
mailing or transmission under 37 CFR 1 .8(a). Proper use of this procedure will result in 
such communication being considered as timely if the established date is within the 
required period for reply. The Certificate should be signed by the individual actually 
depositing or transmitting the correspondence or by an individual who, upon information 
and belief, expects the correspondence to be mailed or transmitted in the normal course 
of business by another no later than the date indicated. 
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Certificate of Mailing 

I hereby certify that this correspondence is being deposited with the United States Postal Service with 
sufficient postage as first class mail in an envelope addressed to: 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 

on . 

(Date) 

Typed or printed name of person signing this certificate: 



Signature: _ 

Registration Number: 

Certificate of Transmission 

I hereby certify that this correspondence is being facsimile transmitted to the United States Patent and 

Trademark Office, Fax No. ( ) - on . 

(Date) 

Typed or printed name of person signing this certificate: 



Signature: . 

Registration Number: 

Please refer to 37 CFR 1 .6(d) and 1 .8(a)(2) for filing limitations concerning 
facsimile transmissions and mailing, respectively. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dominic D. Saltarelli whose telephone number is (571 ) 
272-7302. The examiner can normally be reached on Monday - Friday 9:00am - 
6:00pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Miller can be reached on (571) 272-7353. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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